tag:blogger.com,1999:blog-4476863800158400170Thu, 15 Sep 2022 09:14:11 +0000HAHA scale scaling scalability performance availability reliabilityavailabilityclusteringconnector interface api direct data accessconnector loop feed flow parse attribute hook on no match on multiple foundcustom connector component library api notes domino extend tdidb2 sql jdbc error code log troubleshoot debugdebug debugger troubleshoot explore script technique javascript ecmascriptelevator pitch blurb sales explanationforum java string handling javascript jscript InterpretExceptionism service management taddm assetism service management taddm asset service desk tsrm ticket helpdeskjava class name scriptjava script exception try catch variable undefinedlotus connections profiles syncdbfromsourceperformancescalabilityscalescale scaling performance availability reliatbilityscalingscript domino multivalued attributesolution directory customize setting preferencesync synchronize password technique single loginsystem store cloudscape derby backupRamblings on the paradigm-shift that is TDI.https://www.tdiingoutloud.com/noreply@blogger.com (Eddie Hartman)Blogger77125tag:blogger.com,1999:blog-4476863800158400170.post-8694371722907798590Mon, 04 Oct 2021 18:21:00 +00002021-10-15T20:11:17.165+02:00...as soon as the first shot is fired. However, the art of planning is invaluable. In other words, plan for change and be ready to change your plans. Repeatedly. This be the foundation of an agile approach to solution development.I agree with Ken Schwaber in that many agile methodologies do not feel very agile. Some major contenders are thinly veiled command-and-control frameworks in which you https://www.tdiingoutloud.com/2021/10/i-agree-with-ken-schwaber-in-that-many.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-7162261451079550788Sun, 13 Dec 2020 10:43:00 +00002020-12-13T11:43:03.611+01:00...to paraphrase Forest Gump. TDI (aka SDI) is an extraordinarily agile platform for exploration, prototyping and crafting enterprise-strength solutions for data movement and services. However, using it or any other tool does not an agile developer make. Agile development is all about mindset and culture rather than processes and tools. In this age of industrialized and weaponized Agile (the nounhttps://www.tdiingoutloud.com/2020/03/agile-is-as-agile-does.htmlnoreply@blogger.com (Eddie Hartman)5tag:blogger.com,1999:blog-4476863800158400170.post-8975826159575693281Tue, 01 Dec 2020 13:04:00 +00002020-12-01T14:04:49.536+01:00Here for your perusal is a self-contained solution that provides a service AL that listens for incoming requests coming from QRadar Event Rules. You write your own ALs to perform actions based on various events, using data shared by QRadar in the event action request JSON. Note that this is part of the Guardium bundle, leveraging it to automatically perform reconfiguration, like locking https://www.tdiingoutloud.com/2020/12/how-to-turn-security-events-from-qradar.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-6782558182424094229Thu, 23 Jan 2020 08:21:00 +00002020-01-23T09:23:05.233+01:00When IBM acquired the integration powertool back in 2002 it was called 'IBM Data Integrator'. Then after a bit of political squabbling, it was moved to the Tivoli brand and renamed 'Tivoli Directory Integrator'. Now, after its move to the Security brand a few years back, the name became 'Security Directory Integrator'. I just think of it as 'Integrator', although my fingers still type 'TDI'. Oldhttps://www.tdiingoutloud.com/2020/01/sdi-tdi-whats-in-name.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-7071620086945134927Mon, 17 Jun 2019 12:37:00 +00002019-06-17T14:37:57.137+02:00Although this article is particularly about asking hackers there are some universally relevant pearls here that are ring particularly true today: http://catb.org/~esr/faqs/smart-questions.html It's easiest to go for the quick fix when it comes to information gathering. It's apparent in the alarming number of people who's primary news source is social media, and it's highlighted nicely in this https://www.tdiingoutloud.com/2019/06/how-to-ask-smart-questions.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-7208166016065379042Tue, 04 Jun 2019 12:22:00 +00002019-06-04T14:23:39.849+02:00NOTE: You must remember to copy the ibmdiservice.exe and ibmdiservice.props files from the <InstallDir>\win32_service folder to your Solution Directory (soldir) before you run the service installer. It is a common mistake to run the service installer from the wrong folder - i.e. not your soldir. Often this is done from <InstallDir>\win32_service where the .exe and .props files are found. And ifhttps://www.tdiingoutloud.com/2019/06/sditdi-as-windows-service.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-3312445289204918143Tue, 25 Sep 2018 14:08:00 +00002019-06-04T14:29:09.711+02:00My favorite agile tool is TDI (and please forgive an old man for having trouble shifting to 'SDI'). Not only can I whip together integration service prototypes faster than anything I can do in Java (Spring), or Python or TurboPascal, but I can also build Ops features this way. Monitoring and remote control (pause, restart, failover/failback) for enabling auto-healing, or at least making the https://www.tdiingoutloud.com/2018/09/thinking-about-agility.htmlnoreply@blogger.com (Eddie Hartman)1tag:blogger.com,1999:blog-4476863800158400170.post-5720246433697319762Tue, 24 Oct 2017 09:51:00 +00002020-04-24T13:42:05.986+02:00 November 7, 2013 - Connector Loops and why you're gonna love them September 30, 2013 - Why Loops Instead Of Lookup Mode  November 7, 2013 - Why Connector Loop June 8, 2010 Loop a Connector today https://www.tdiingoutloud.com/2017/10/collecting-my-ramblings-on-connector.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-5785294537173104940Thu, 31 Aug 2017 23:14:00 +00002019-03-18T09:54:48.280+01:00 The Basics Install TDI (https://ibm.biz/BdjsLw) locally to your laptop. This lets you customize your TDI environment easier. If you can't get a licensed version, start with the free version (https://ibm.biz/BdjiMg). It's fully functionally, will give you time needed to get started solving with TDI, and the license file can be replaced when you get yours. Do NOT install under Program Files on https://www.tdiingoutloud.com/2017/09/tdi-for-newbies.htmlnoreply@blogger.com (Eddie Hartman)7tag:blogger.com,1999:blog-4476863800158400170.post-3761558625416322938Tue, 13 Dec 2016 13:25:00 +00002016-12-13T14:25:49.627+01:00 Writing RMI Adapter AssemblyLines can be tricky at times, especially when it comes to the Search AL - the one used for Reconcile operations. This is because the Dispatcher calls the Search AL in Cycle mode, which causes it to work differently than you might expect. The usual behavior of an AL is that an Iterator in the Feed section delivers data - one Entry at a time - into the Data Flow https://www.tdiingoutloud.com/2016/12/how-to-make-searchreconcile-al-for-rmi.htmlnoreply@blogger.com (Eddie Hartman)2tag:blogger.com,1999:blog-4476863800158400170.post-4262957381442979437Mon, 12 Dec 2016 11:47:00 +00002016-12-13T10:19:50.983+01:00When you go to make an HTTP request to a service that requires an SSL connection, you'll get an exception that your HTTP Client Connector cannot set up the secure link to the service. Unlike your browser, TDI (SDI) does not automatically import the client certificate. You have to do this yourself, and this post is about how to do this. For this example, we'll try to access https://https://www.tdiingoutloud.com/2016/12/importing-client-certificate-in-order.htmlnoreply@blogger.com (Eddie Hartman)8tag:blogger.com,1999:blog-4476863800158400170.post-5021132774918028010Mon, 21 Nov 2016 13:29:00 +00002016-11-21T14:29:08.697+01:00As promised, this post will walk you through creating a custom Connection Tab Form for the Connector scripted in the previous post. Myself being in true form, I will begin with a promised explanation and then a bit of theory. Internal name of a component In my last post I promised to show you how to discover the internal name of a component. Otherwise, how can you know that the HTTP Client https://www.tdiingoutloud.com/2016/11/json-and-xml-tutorial-part-6-making.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-6113222385566190947Thu, 17 Nov 2016 14:23:00 +00002016-11-18T15:26:58.408+01:00Continuing from my last rambling post, we'll script an Iterator Connector that will return the same parsed entries as our Conditional Loop did. I'll begin with a little theory, which you will find duplicated other places like the How-To page of www.tdi-users.org and this venerable video tutorial on the subject. To script a component in TDI (SDI) you start with the basic Script version of that https://www.tdiingoutloud.com/2016/11/json-and-xml-tutorial-part-5.htmlnoreply@blogger.com (Eddie Hartman)8tag:blogger.com,1999:blog-4476863800158400170.post-3375508887283250941Wed, 16 Nov 2016 14:36:00 +00002016-11-21T11:32:29.698+01:00 Practice examples are helpful when mastering new techniques. In this example we'll make a REST request and then handle the return JSON payload. We'll be using the service available at the following URL: http://www.ideal-status.nl/static/consumer_notification_advice.json If you dial up this URL you'll get JSON that looks like this: {"0021":{"issuer_id":"0021","issuer_bic":"RABONL2U","https://www.tdiingoutloud.com/2016/11/json-and-xml-tutorial-part-4-json.htmlnoreply@blogger.com (Eddie Hartman)15tag:blogger.com,1999:blog-4476863800158400170.post-3350087066678190082Mon, 14 Nov 2016 14:46:00 +00002020-04-12T13:14:06.628+02:00Those of you who want to learn more about the truly marvellous concept of MapReduce (thanks, Google!) or just want to play with the can't-believe-it's-free CouchDB, here is a connector I wrote a while back that supports both CouchDB and Cloudant. All you need to do is download a free copy of CouchDB (painless install and loads of fun), or sign up for your free Cloudant db in the cloud at https://https://www.tdiingoutloud.com/2016/11/couddbcloudant-connector.htmlnoreply@blogger.com (Eddie Hartman)2tag:blogger.com,1999:blog-4476863800158400170.post-1910266866649400005Mon, 22 Feb 2016 11:13:00 +00002016-02-22T12:16:28.868+01:00 Continuing on from Part 1 of this tutorial, let's play a little with XML data using the HEntry techniques discussed. Here is some example XML that we'll play with: <teams> <team name="Stark"> <sigil>Direwolf</sigil> <member position="pitcher">Robb</member> <member position="crowsnest">Bran</member> </team> <team name="Lannister"> <sigil>Lion</sigil> <member https://www.tdiingoutloud.com/2016/02/json-and-xml-tutorial-part-2-xml-example.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-8599986596970781363Wed, 13 Jan 2016 17:43:00 +00002016-01-13T18:43:02.805+01:00Hit the More... button at the top of the AttMap - to the right of the Add and Delete buttons - and select Change inheritance. In the resulting dialog click External attribute map and select a file. The external mapping feature of TDI uses text files that contain one or more mapping rules. Each mapping rule looks like this: name=assignment. Here is an example of a mapping rule: uid= This https://www.tdiingoutloud.com/2016/01/externalizing-attribute-map-to-file.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-3112115593206497063Fri, 10 Apr 2015 13:55:00 +00002015-04-10T15:55:36.151+02:00The System Store is a database that TDI uses to 'remember' stuff like: the last change read, when you use one of the Change Detection Connectors (also called CDCs); the snapshots of data used to compute changes when using the Delta Engine together with an Iterator Connector; data read using the System Store Connector, which writes and reads full Entry objects with any number of Attributes; https://www.tdiingoutloud.com/2015/04/what-is-system-store.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-8298222389005409909Mon, 02 Mar 2015 18:52:00 +00002015-03-02T19:52:47.590+01:00I have cobbled together a simple AL that can be run from the commandline in order to import a client certificate from an HTTPS service. For example: ibmdisrv -c configs/tdiingOL.xml -r importcert -0 https://supportcenter.checkpoint.com The above call results in this output (including the standard TDI is startup messages): CTGDKD024I Remote API successfully started on port:1099, bound to:'https://www.tdiingoutloud.com/2015/03/importing-client-certificate-from-https.htmlnoreply@blogger.com (Eddie Hartman)1tag:blogger.com,1999:blog-4476863800158400170.post-8216933161752830761Wed, 11 Feb 2015 13:21:00 +00002015-02-11T14:21:56.323+01:00Well, this one is focused on JSON and I rolled it into a quick video. https://www.youtube.com/watch?v=VHmf76FMI-U Enjoy, and please comment if anything is unclear (or unsaid).https://www.tdiingoutloud.com/2015/02/json-and-xml-tutorial-part-2.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-8316964985020890666Thu, 05 Feb 2015 12:55:00 +00002015-02-05T13:55:32.405+01:00All you have to do is make AssemblyLines with the names of the operations you want to expose. For example, I have a solution that catches incoming events over TCP  and dispatches the payload data to one or more 'event triggered' AssemblyLines. Like all server mode based ALs, this one uses multiple threads to deal with client traffic (the AL Pool), and shared log output can get a little https://www.tdiingoutloud.com/2015/02/easily-implementing-monitoring-api-to.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-6148637268368304248Mon, 26 Jan 2015 11:25:00 +00002015-01-26T12:25:21.507+01:00In the ibmdisrv command-line used to launch your AssemblyLine, you can use one of the user-defineable options -0 through -9 to pass information into the AL. For example, in order to pass the name of an input file to the AssemblyLine named 'ReadFile' you could use this command-line:   ibmdisrv -c MyConfig.xml -r ReadFile -0 c:/Input/HRExport.csv Then in the Prolog - Before Initialize Hook of https://www.tdiingoutloud.com/2015/01/passing-arguments-to-your-al-when.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-279460766279156508Mon, 24 Nov 2014 12:27:00 +00002014-11-24T13:27:04.480+01:00This is done with a little effort in three areas: Error handling Log handling Auto-reconnect For Error Handling you need to add code to the Prolog - On Error Hook for connection errors in components, and to the DataFlow - Default On Error (the catch-all Error Hook for all Connector modes). Here you will want to capture all error information to the log in order to help troubleshooting the issue.https://www.tdiingoutloud.com/2014/11/hardening-assemblyline.htmlnoreply@blogger.com (Eddie Hartman)0tag:blogger.com,1999:blog-4476863800158400170.post-4476826526548863585Mon, 04 Aug 2014 09:49:00 +00002014-08-04T11:49:44.738+02:00 I've gotten this question (again) and decided to explain it here so that Google can find it. Null Behavior allows you to deal with missing data without having to write Javascript. The Null Behavior feature lets you define what a 'null' attribute is and how it should be handled. By default the definition of 'null' is that the source attribute is missing or has no value (null value). The https://www.tdiingoutloud.com/2014/08/null-behavior.htmlnoreply@blogger.com (Eddie Hartman)2tag:blogger.com,1999:blog-4476863800158400170.post-3618449814466369082Sat, 12 Jul 2014 09:25:00 +00002014-07-12T11:25:02.932+02:00Here is an excellent explanation of mapReduce that I've had to share (again and again). Enjoy! http://www.slideshare.net/okurow/couchdb-mapreduce-13321353https://www.tdiingoutloud.com/2014/07/mapreduce-revealed.htmlnoreply@blogger.com (Eddie Hartman)0